wo 2004/111937 



1 



PCT/IB2004/0S0868 



3D image segmentation 



5 

The present invention relates to the field of digital imaging and, more 
particularly, to the field of 3D image segmentation by the use of deformable models. In 
detail, the present invention relates to a method of segmenting a three-dimensional 
structure of interest, to an image processing device and to a computer program for an 
10 image processing unit. 

Since the discovery of x-rays over one hundred years ago, radiation has 
been used increasingly in medicine, both to help with diagnosis (by taking pictures with 
x-rays), and as a treatment (radiotherapy). However, radiation obviously has to be used 
with care. 

15 Radiotherapy, also called radiation therapy, is the treatment of cancer and 

other diseases with ionizing radiation. Ionizing radiation deposits energy that injures or 
destroys cells in the area being treated (the "structure, object or region of interest") by 
damaging their genetic material, making it in^ossible for these cells to continue to 
grow. Although radiation damages both cancer cells and normal cells, the latter are able 

20 to repair themselves and function properly. Radiotherapy may be used to treat localized 
solid tumors, such as cancers of the skin, tongue, larynx, brain, breast, or uterine cervix. 
It can also be used to treat leukemia and lymphoma (cancers of the blood-forming cells 
and lymphatic system, respectively). 

One type of radiation therapy commonly used involves photons, 

25 "packets" of energy. X-rays were the first form of photon radiation to be used to treat 
cancer. Depending on the amount of energy they possess, the rays can be used to 
destroy cancer cells on the surface of or deeper in the body. The higher the energy of the 
x-ray beam, the deeper the x-rays can go into the target tissue. Linear accelerators and 
betatrons are machines that produce x-rays of increasingly greater energy. The use of 

30 machines to focus radiation (such as x-rays) on a cancer site is called extemal beam 
radiothen^y. 
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Gamma rays are fnother form of photons used in radiofherapy. Gamma 
rays axe produced spontaneously as certain elements (such as radium, uranium, and 
cobalt 60) release radiation as they decon^ose, or decay. Each element decays at a 
specific rate and gives off energy in the form of gamma rays and other particles. X-rays 
and gamma rays have the same effect on cancer cells. 

Another technique for delivering radiation to cancer cells is to place 
radioactive implants directly in a tumor or body cavily. This is called internal 
radiotherapy. (Brachytherapy, interstitial irradiation, and intracavitary irradiation are 
types of internal radiotherapy.) In this treatment, the radiation dose is concentrated in a 
small area, and the patient stays in the hospital for a few days. Internal radiotherapy is 
frequently used for cancers of the tongue, uterus, and cervix. 

Several new approaches to radiation therapy are being evaluated to 
determine their effectiveness in treating cancer. One such technique is intraoperative 
irradiation, in which a large dose of extemal radiation is directed at the tumor and 
surrounding tissue during surgery. 

Another approach is particle beam radiation therapy. This type of therapy 
differs from photon radiotherapy in that it involves the use of fast-moving subatomic 
particles to treat localized cancers. Some particles (neutrons, pions, and heavy ions) 
deposit more energy along the path they take through tissue than do x-rays or gamma 
rays, thus caxising more damage to the cells they hit This type of radiation is often 
referred to as high linear energy transfer (high LET) radiation. 

Scientists also are looking for ways to increase the effectiveness of 
radiation therapy and to a minimise the radiation applied to the patient For this, a 
radiotherapy planning may be perfomed using e.g. diagnostic data such as images to e.g. 
accurately identify a region, structure or object of interest and e.g. a tissue type 
surrounting this region. 

Segmentation methods may be used to derive such structures of interest, 
such as, for example, organs or bones from volumetric image data (diagnostic images), 
such as CT, MR or US images. One popular segmentation approach is the use of 
deformable models. A survey about deformable models has been, for example, 
published by Mclnemey et al.: "Deformable models in medical image analysis: A 
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survey". Medical Image Analysis, 1 (2): pp. 91-108, 1996. A defoimable model can be 
represented as an elastic surfiEu^e, the shape and position of which can change under the 
influence of an internal energy and an external eneigy. The internal energy serves to 
preserve as well as possible the shape of the model (which may have been formed on 

5 the basis of prior knowledge concemmg the structure to be segmented). The external 
energy, however, shoidd move the model surfisice in the direction of the object's edges. 
The external energy is derived from a three-dimensional image, that is from a dataset, 
which is a three-dimensional representation of the object containmg the structure. Such 
a three-dimensional representation of the object usually consists of a plurality of two- 

10 dimensional images, each representing a slice of the object. The meshes are preferably 
shaped as triangles, the comer points of which are defined by three neighboring network 
points on the surface of the model. 

According to the known method, structure points are searched on the 
surface of the structure to be segmented, i.e. along search lines, which may extend 

15 perpendicular to the triangular surfaces iA the image. The sur&ce of the structure to be 
segmented is usually characterized by a pronounced gradient of the image data. After 
the determination of such structure points for the meshes of the network defining the 
surface of the model, the network points of the model are calculated anew on the basis 
of the structure points foxmd, i.e. the network points are calculated in such a manner that 

20 the weighted sum of the intemal energy and the external energy assumes a minimum 
value for the newly found network points. According to this method, the position of the 
network points is influenced, not only by the directly neighboring structure points found 
d\iring the search, but also by all other structure points. Subsequently, the method is 
repeated iteratively a nxmiber of times, by utilizing the newly calculated network points. 

25 Thus, the model is deformed upon each iteration, and the shape assumed by the model 
after the last iteration, i.e. after a shut-off criterion has been reached, is considered to be 
the structure to be segmented in the concrete object. 

The three-dimensional image of the object may be generated, for 
example, during medical examinations, by means of the x-ray computed tomography 

30 method, the magnetic resonance method, or the ultrasonic method. 
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In other words, according to the above method, the deformable model 
fitting process is guided by minimization of the sum of the external energy, based on 
image feature information, which attracts the mesh to the boundaries of the structure of 
interest, and an internal energy, which preserves the consistent shape of the mesh. 

5 A problem that may occur, for example, during the segmentation of the 

structure of interest using CT image data, is that the three-dimensional image often does 
not contain reliable feature information, for example, image gradients, to attract the 
mesh. In other words, it may occur that in some of the two-dimensional slices of the 
three-dimensional image, the surface of the structure of interest is not visible" to the 

10 segmentation process, due to, for example, an insufficient gradient of tiie image data to 
attract the mesh. This may appear for several reasons: a poor discrimination of soft 
tissue, for example, in CT, a low image resolution or artifacts due to metal implants. 

It is an object of the present invention to provide for an improved 

segmentatioiL 

1 5 According to an exemplary embodiment of the present invention, the 

above object may be solved with a method of segmenting a three-dimensional structure 
of interest containing an object from a plurality of two-dimensional images in 
accordance with claim 1 . According to this exemplary embodimmt of the present 
invention, images of the plurality of two-dimensional images with insufficient feature 

20 information for the structure of interest are identified Then, attractors in the form of at 
least a partial contour of the structure of interest are manually drawn in the images of 
the plurality of two-dimensional images with insufBcient feature information. Then, the 
structure of interest is segmented in the plurality of images by using, for example, the 
segmentation algorithm described above, with the manually drawn attractors replacing 

25 structure points in the areas of two-dimensional images where feature information is 
insufficient. Advantageously, according to an aspect of the present invention, this 
method may enable a more reliable fitting of 3D deformable models to structures, such 
as organ parts, where poor contrast, noise or image artifacts do not allow for a fully 
automatic boundary delineatioiL Furthermore, this may advantageously improve a 

30 robustness of the segmentation process. 
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Furthennore, in instances where, for example, from a hundred two- 
dimensional images forming the three-dimensional image, only, for exeaxxplo, twenty 
contain insufBcient feature information for the structure of interest, according to the 
present invention the manual placement or drawing of the attractors has only to be 
5 performed in these twenty images and not in all hundred images. Thus, the interaction 
required from a user is minimized, which, in particular in clinical applications, is a 
critical concern. 

According to another exemplary embodiment of the present invention as 
set forth in claim 2, the identification of two-dimensional images with insufficient 

10 feature information includes a segmentation process. In other words, according to the 
present invention, the segmentation process is applied to the three-dimensional image. 
Then, on the basis of the segmentation results from this first segmentation process, 
images of the two-dimensional images are identified containing insufficient feature 
information. Then, for these images with insufficient feature information, the manually 

15 drawn attractors are added. Then, a second segmentation process is performed, in which 
the attractors are included in the inaages previously identified as having insufficient 
feature information. 

Advantageously, according to this exemplary embodiment of the present 
invention, the same segmentation process used for the final segmentation may be used 

20 for identification of the images containing insufficient feature information. 

According to another exemplary embodiment of the present invention as 
set forth in claim 3, the segmentation of the structure of interest in the plxirality of 
images is based on an iterative optimization of intemal and external energy. Such 
structure segmentation based on an energy optimization is described in further detail by 

25 Weese et al,: "Shape constramed deformable models for 3D medical image 

segmentation", Proc. of 17* Intemational Conference on Information Processing in 
Medical Imaging (IPMI), pages 380 to 387, Davies, CA, USA, 2001, Springer-Verlag, 
which is hereby incorporated by reference. 

Advantageously, the method according to this exemplary embodiment 

30 allows for a fast, efficient and very accurate segmentation process, which is also robust 
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According to another exemplary embodiment of the present invention as 
set forth in claim 4, the segmentation for finally segmenting the structure of interest is 
also based on en^gy minimization, as, for example, described by Weese et al.: ^'Shsqpe 
constrained defoimable models for 3D medical image segmentation", Proc. of 17^ 
5 International Conference on Information Processing in Medical Imagmg (IPMI), pages 
380 to 387, Davies, CA, USA, 2001, Springer-Verlag, which is hereby incorporated by 
reference. 

According to another exeroplary embodiment of the present invention as 
set forth in claim 5, the manual drawing of attractors in the form of at least a partial 

10 contour of the structure of interest in the images of the plurality of two-dimensional 
images including insuflBcient feature information, involves an assigrmient of labels to 
voxels corresponding to the at least partial contour, such that the attractors are 
considered as strong edges of the structure of interest during segmentation. Thus, 
according to this exemplary embodiment of the present invention, the attractors are 

1 5 labeled such that they simulate a surl^ boundary of the structure of interest, i,e, a 
prono\mced gradient in the image data. Thus, the method according to the present 
invention may, without further adaptation, be applied to a plurality of segmentation 
methods. 

According to another exemplary embodiment of the present invention as 
20 set forth in claim 6, the method is for radiation therapy planning (RTP) on the basis of 
CT images. Advantageously, this exemplary embodiment of the present invention 
allows for an iii^)roved radiation therapy planning, due to the fast and accurate 
segmentation of the structure of interest 

According to another exemplary embodiment of the present invention as 
25 set forth in claim 7, an image processing device is provided, comprising a memory for 
storing the images, a pointer for drawing the attractors, and an image processor for 
segmenting the three-dimensional structure of interest in the images. According to an 
aspect of the present invention, attractors are manually drawn, which may correspond to 
at least a partial contour of the boundaries of the structure of interest in images with 
30 insufficient feature information. For this, the device may be adapted to prompt a user to 
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make the respective input Due to this, an inqproved segmentation is provided, even if 
there are images with insufficient feature information. 

According to another exenq>laiy embodiment of the present invention as 
set forth in claim 8, an image processing device is provided comprising an image 
5 processor which is further adapted to segment the structure of interest in the plurality of 
images and to identify the images of the plurality of 2-dimen5ional images with 
insufiGcient feature information for the structure of interest on the basis of at least one 
decision criterion. 

Advantageously, due to, for example, the use of the decision criterion, a 

10 very fast, stable and robust process may be provided requiring only a reduced amount of 
operations, which allows to use a processor having a reduced performance. For 
example, by accordingly setting this decision criterion, the amount of operations 
required for segmentation may be reduced to an amoimt such that the image processing 
device may be implemented with a personal computer (PC) or workstation. 

1 5 Accordiag to another exemplary embodiment of the present invention as 

set forth m claim 9, the image processor of the image processing device is ad^ted to 
perform a segmentation of the structure of interest with an iterative optimization of an 
internal and an external energy. This allows for a very accurate segmentation while 
keeping the required computational power low. 

20 According to another exenq)lary embodiment of the present invention as 

set forth in claim 10, an image processing device is provided, comprising an image 
processor adapted to perform a segmentation of the structure of interest by using an 
energy nodnimization. This allows for an image processing device, which is fast, requires 
only reasonable computational perfonnance and which results are highly robust 

25 According to another exemplary embodiment of the present invention as 

set forth in claim 1 1, an image processing device is provided comprising an image 
processor which is adapted such that the manual drawing of attractors in the form of at 
least a partial contour of the structure of interest in the images of the plurality of 2- 
dimensional images by means of the pointer causes the image processor to perform an 

30 assignment of labels to voxels corresponditig to the at least partial contour such that the 
attractors are considered as strong edges of the structure of interest during segmentation. 
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Thus, according to this exemplaiy embodiment of the present invention, the attractois 
are labeled such that they simulate a sur£Eu:e boundaiy of the stmcture of interest, i.e. a 
pronoimced gradient in the image data. Advantageously, this may allow for accurate 
segmentation, even in the case that insufScient image information is contained in 
5 portions of the image. 

According to another exenq)lary embodiment of the present invention as 
set forth in claim 12, an image processing device is provided where the image 
processing device is a radiotherapy planning device, a radiotherapy device, a 
workstation, a computer or a personal computer. In other words, the image processing 

1 0 device may be implemented with a workstation, computer or a personal computer which 
are adapted accordingly. Also, the image processing device may be an integral part of a 
radiotherapy planning device, which is specially adapted, for example for an MD to 
perform a radiotherapy planning. For this, for example, the radiotherapy planning 
device may be adapted to acquire diagnosis data, such as CT images from a scanner. 

1 5 Also, the image processing device may be an integral part of a radiotherapy device. 
Such a radiotherapy device may comprise a source of radiation, which may be applied 
for both acquiring diagnostic data and applying radiation to the structure of interest 

Accordingly, according to exemplary embodiments of the present 
invention, processors or image processing devices which are adapted to perform the 

20 invention may integrated or part of radiation therapy (planning) devices such as e.g. 
disclosed in WO 01/45562 A2 and US 6,466,813 which are both incorporated by 
reference. 

According to another exemplary embodiment of the present invention as 
set forth in claim 13, a con:q)uter program is provided for an image processing unit, for 

25 segmenting a three-dimensional structure of interest from a plurality of two-dimensional 
images. The computer program may be written in any suitable programming language, 
for example, C-H- and may, for example, be stored on a computer readable medium, 
such as a CD-ROM. Also, the computer program may be available from a network such 
as the World Wide Web, from which it may be dovmloaded to an image processing unit 

30 or suitable computer. The computer program, according to this exemplary embodiment 
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of the present invention, perfonns liie method according to the present invention as set 
forth in claim 1. 

It may be seen as the gist of an exemplary embodiment of the present 
invention that images of the two-dimensional images forming a three-dimensional 

5 image of an object are identified, containing insufficient feature information for an 
automatic delineation or segmentation of the three-dimensional stmcture of interest in 
the object Then, according to an aspect of the present invention, in these images, 
attractors are drawn, which may substantially follow at least a partial contour of the 
structure of interest This may be done by an operator. The attractors are such that they 

10 can be easily discriminated by a feature search algorithm of a segmentation process, for 
example, through assignment of specific labels outside the typical intensity range of the 
image to voxels corresponding to the manually drawn contours. In the deformable 
model fitting process or segmentation process, the manually drawn contours may then 
be considered as artificial strong edges, which attract the model. 

1 5 These and other aspects of the present invention will become apparent 

from and elucidated with reference to the embodiments described hereinafter. 

Exemplary embodiments of the present invention will be described in the 
following, with reference to the following drawings: 

20 Fig. 1 shows a schematic representation of an image processing device according to an 

exen^lary embodiment of the present invention, adapted to execute an exemplary 

embodiment of a method according to the present invention. 

Fig. 2 shows a flowchart of an exemplary embodiment of a method 

according to the present invention. 
25 Fig. 3 shows a two-dimensional image of the 3D image, depicting the 

bladder. 

Fig. 4 shows the image of Fig. 3, where attractors have been added to the 
bladder in accordance with the present invention and the model is initialized. 

Fig, 5 shows the image of Fig. 4, where the model is adapted to the 
30 attractors in accordance with the present invention. 
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Fig. 1 shows an exensplary embodiment of an image processing device 
according to the present invention. The image processing device shown in Fig. 1 
includes an image processing and control processor 1 with a memory 2 in which a 
deformable model of a stracture to be segmented can be stored and which is capable of 
S storing a plurality of two-dimensional images forming a three-dimensional image of an 
object to be examined. The image processing and control processor may be coupled^ via 
bus system 3, to an imaging device (not shown in Fig. 1), for example, an MR 
apparatus, a US (ultrasonic) apparatus, or a CT apparatus. The structure segmented by 
the image processing and control processor can be displayed on a monitor 4. The user 

10 can access the image processing and control processor 1 via a keyboard 5 or other input 
means, which aiG not shown in Fig. 1, such as a mouse or a trackball. The keyboard 5, 
the mouse or the trackball are all considered as pointers, by which an operator may 
perform a pointing operation on an image displayed on the monitor 4 to, for example, 
draw attractors in the images displayed on the monitor 4. 

1 5 According to exemplary embodiments of the present inventions, the 

image processing device may be a radiotiierapy planning device, a radiotherapy device, 
a workstation, a computer or a personal computer. In other words, the above image 
processing device may be implemented by means of a computer, workstation, personal 
computer (PC) or the like. Also, the image processing device may be a radiotherapy 

20 planning device adapted to perform a radiotherapy plaiming. Such device may be 
cotmectable to a scanner device such as a CT scanner providing the diagnostic data. 

Also, the image processing device may be a radiother^y device 
comprising e.g. a source of radiation for generating ionized radiation. The radiotherapy 
device may either be for an internal or external radiation treatment E.g. the 

25 radiotherapy device may be a high linear en^gy transfer (high LET) radiation type 
treatment device. Also, the radiotherapy device may apply gamma rays. 

According to another exemplary embodiment, the image processing 
device may be integrated into a radiotherapy device including an x-ray source, such as 
e.g. a CT scanner. The x-ray source may be adapted for acquiring images of the 

30 structure of interest and to apply radiation to the structure of interest to perform the 
radiation therapy treatment 
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Fig. 2 shows a simplified flowchart of a method or a computer program 
according an exemplary embodiment of the present invention for operating the image 
processing device depicted in Fig. 1 . In the following example, CT images are used. 
However, it has to be noted that, as indicated above, the method of the present invention 

5 may also be applied to other suitable images. After the start in step SI, the method loads 
a plurality of two-dimensional CT images forming a three-dimensional image of an 
object firom, for example, a CT scanner in step S2. Then, the method continues to step 
S3, where an automatic segmentation process is performed on the plurality of two- 
dimensional CT images in order to determine images of the plurality of two- 

0 dimensional images with insufficient feature information for the structure of interest 
The segmentation process or defonnable model fitting process is, as will be explained in 
further detail in the following, guided by minimization of the siun of an external energy, 
based on image feature information, i.e. a pronounced gradient designating a surface of 
the structure of interest, which attracts the mesh to the boundaries of the structure of 

S interest and an internal energy, which preserves the consistent shape of the mesh. A 
problem in the segmentation process may occur if the two-dimensional images in the 
three-dimensional image do not contain reliable feature information, for example, image 
gradients, to attract the mesh. This may happen due, for example, to a poor 
discrimination of soft tissue, for example, in CT, to a low image resolution of the two- 

0 dimensional images, artifacts due to implants, such as, for example, metal implants or 
the like. 

In the segmentation process performed in step S3, a defonnable model 
M, for example, of the bladder, is adapted to the structure of interest The smf ace of the 
model is formed by a network, the triangular meshes of which connect three 

5 neighboring network points on the surface of the model to one another three times. 

Instead of a model thus subdivided into triangles, the surface of the 
model could also be defined by a polygonal structure, in which the meshes of the 
network do not have a triangular shape, but link a number of network points other than 
three to one another in the form of a polygon or a simplex. 

0 The defonnable model is usually represented by a mesh consisting of V 

vertices with coordinates and T triangles. To adapt the mesh to the structure of 
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interest in the two-dimensional image, an iterative piocedure is used, where each 

iteration consists of a sur&ce detection step and a mesh reconfiguration step. Mesh 

reconfiguration is done by minimizing: 

E^E^+aE,^ (1) 
S The external energy Ecxt drives the mesh towards the surface patches 

obtained in the surface detection step. The internal energy Ejnt restricts the flexibility of 

the mesh. The parameter a weights the relative influence of each term. The different 

components of the algorithm are now described in the following: 

Surface detection 

10 For surface detection, a search is performed along a triangle normal nj to 

find a point 3c; with the optimal combination of feature value Ft(^i) and the distance Sj 

to the triangle center jc^ : 

X, = jc,+n,^argmax{i5;(x, ^-n,^)^'DS''f) 
y = -/, / 

The parameter / defines the search profile length, the parameter 5 is the 
15 distance between two successive points, and the parameter D controls the weighting of 
the distance information and the feature value. For example, the quantity 

F.ix)-±n,g(x) ^^^„^(^),p) (3) 

may be used as a feature, where ^x) denotes the image gradient at point 
X , The sign is chosen in dependence on the brightness of the structure of interest, with 
20 respect to the surrounding structures. For image points with a gradient magnitude 

smaller than a threshold g^^, this quantity is essentially the gradient in the direction of 
the mesh normal. 

During segmentation, this threshold prevents problems that occur, if the 
stmcture of interest has a considerably smaller gradient magnitude at the boundary than 
25 other objects in the neighborhood, or if different parts of the object of interest have 
boundaries with considerably different gradient magnitude. 
External enerev 

In analogy to iterative closest point algorithms, the external energy 
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=£w,(*, -x.)\w, =max{O.F,(x,)-Z)(jc, -x,)^} (4) 

i-l 

may be used, where the weights Wg have been introduced to give the 
more promising surface points % a larger influence during mesh reconfiguration. With 
this external energy, the detected surface points would directly attract the triangle 
centers of the mesh. As a consequence, once a triangle center has been attracted by a 
surface point in the image, it can hardly move anymore. For this reason, the mesh 
remams attached to false object boundaries, which are detected frequently at the 
beginning of the adaptation process. This problem is diminished considerably if the 
triangle centers x. are attracted by the planes perpendicular to the image gradient at the 

surface point x. : 

II giXf) II 

As may be gathered firom the above equations, the extemal energy is 
based on a distance between the deformable model or shape model after adaptation and 
. feature points, i.e. a boundary of the structure of interest. 
Internal energy 

The starting point for the introduction of the intemal energy is a shape 
model represented by a mesh of triangles with vertex coordinates 

mf^mf-^^Pj^f; i = l,...,F. (6) 

In this equation, ml denote the vertex coordinates of the mean model, 

mf describe the variation of the vertex coordinates associated with the M eigenmodes of 

the model, and 

represent the weights of the eigenmodes. 

Since the shape model provides a suitable distribution of mesh vertices, 
the intemal energy has been designed to maintain this distribution. For that purpose, the 
difference vectors between the coordinates of two neighboring mesh vertices are 
considered. Difference vectors for the deformable model and the shape model are 
compared, and the deviations between both are penalized: 
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where the setisr(0 contains the nei^bors of vertex i . The scale s and the 

orientation R of the shape model, as well as its weights , have to be determined in 

addition to the vertex coordinates Xj during the mesh reconfiguration. 

5 The segmentation process, i.e. the mesh reconfiguration is then 

performed by minimization of the total energy E as set forth in equation (1). 

This method is described in further detail by Weese et al.: "Shape 
constained deformable models for 3D medical image segmentation", Proc, of 17^ 
Intemational Conference on Information Processing in Medical Imaging (IPMI), pages 
10 380 to 387, Davies, CA, USA, 2001, Springer-Verlag, which is hereby incorporated by 
reference. 

Then, in the subsequent step S4, images of the plTjrality of two- 
dimensional images, such as CT images, where the automatic segmentation failed, are 
identified. However, an image containing insufficient feature information may also be 

1 5 identified by an operator in a way that it is displayed to the operator on the monitor 4, 
who may then decide. In case the image does not contain sufficient feature information, 
i.e. the automatic segmentation in accordance with the method described with reference 
to step S3 fails, in step S5, attractors may be manually drawn by an operator in these 
images identified in step S4. For this, these images with insufficient feature information 

20 may be displayed to the operator who places the attractors by means of the pointer. 
Preferably, these attractors correspond to at least a partial contour of the stmcture of 
interest As already mentioned, the manually drawn attractors may have the form of 
conq)lete or partial contours corresponding to the boxmdaries of the structure of interest. 
These attractors are such that they can be easily discriminated by the feature search 

25 algorithm, which is part of the segmentation process performed in the subsequent step 
S6. This may be ensured, for example, through the assignment of specific labels outside 
the typical intensity range for the image data to the voxels corresponding to the 
manually drawn contours. In other words, by the manually drawn attractors, the 
boundaries or portions of the structure of interest may be characterized by an artificially 
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pronounced gradient of the image data. Then, in the subsequent segmentation process or 
defoimable model fitting process, the manually drawn contours or attractors may be 
considered as artificial strong edges, which attract the model in the absence of reliable 
image feature information. 
S For the manual drawing of attractors in these edges, these images may be 

individually displayed to the operator via the monitor 4. 

In the subsequent step S6, an automatic segmentation process is 
performed on the plurality of two-dimensional images, such as CT images, by \jsing the 
attractors. The method used as the automatic segmentation method, is preferably the 

10 same as described with reference to step S3, Thus, in order to avoid unnecessary 

repetition, reference is made to step S3 for the description of the segmentation process. 
In step S6, due to the fact that in the images with insufficient feature information with 
respect to the structure of interest, the attractors ^'simulate" an artificial strong edge, or a 
pronounced gradient, the segmentation is successful in all of the plurality of two- 

15 dimensional images, even in the images with insufBcient feature information. Then, in 
the subsequent step S7, the segmentation results obtained in step S6 are output, for 
exanq>le, via the monitor 4 and then the method continues to step S8, where it ends. 

Advantageously, the above described method allows to significantiy 
roduce the amoxmt of interaction required from an operator, since the attractors do not 

20 have to be added to all of the plurality of two-dimensional images, but only to those 
containing insufficient feature information, where the automatic segmentation fails. 
Furthermore, advantageously, the present invention allows to improve the robustness of 
automated organ delineation tools, for example, in RTF systems. FinAennore, in 
particular in radiation therapy plaiming, improvements can be achieved, since the 

25 segmentation results achieved with the present invention are highly accurate and allow 
for an accurate radiation therapy planning. Also, due to the semi-automatic interaction 
by the operator, a highly reliable setting of the deformable models to the structure of 
interest, such as organ parts, can be achieved, even where poor contrast noise or image 
artifacts do not allow a fully automatic boundary delineation, 

30 Fig. 3 shows a two-dimensional CT image depicting the hip region of a 

male patient. Reference numerals 10 and 12 designate femur heads and reference 
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niimeral 13 designates the pelvis. Reference numeral 14 designates the spinal cord. 
Between two pelvis portions 16 and 1 8, the bladder 20 is located. As may be taken from 
Fig. 3, the bladder 20 is almost indistinguishable and there are no pronounced gradients 
in the image data of Fig. 3, clearly identifying boundaries of the bladder 20. 
S Fig. 4 shows the image of Fig. 3, where the contour 22 of the bladder 20 

was marked manually by, for exanq)le, an operator tracing the boundary or contour of 
the bladder 20 with a pointer device on the monitor 4, such that the voxels in the image 
of Fig. 4 are labeled accordingly. As may be taken from Fig. 4, the contour 22 is 
completely white, and thus represents a strong edge, which can easily be segmented by 

10 the segmentation process, since it strongly attracts the model. The starting model to be 
adapted to the contour 22 of the bladder 20 is indicated in Fig, 3 by reference numeral 
24. As may be taken from Fig. 4, at the begiiming of the segmentation process, the 
model 24 is not closely adapted to the contow 22 of the bladder 20. 

Fig, 5 shows the image of Fig. 4 at the end of the segmentation process, 

1 S when the model 24 is closely matched to the contour 22. 

Accordingly, as may be taken from a comparison of Figs. 3 and 5, even 
in cases where the feature information included in the image is not sufficient to clearly 
distinguish boundaries of a structure of interest, such as the bladder 20, the present 
invention allows a highly accurate semi-automatic segmentation of such structure of 

20 interest. 



